The first church I entered as a JW was the Vatican! As an art and history lover, I saw it more from those angles, although the brain-washed part of me saw it as "Babylon the Great".
After I left the JWs, an ex-JW couple invited me to attend their church. It was a small but very old Anglican church, one that I could have imagined my grandparents attending. It was nice and simple. I was slightly apprehensive at first, but I soon realised it was just a building filled with people who wanted to worship their God.
Ten yrs later, I don't have any problems with entering a church. I'm no longer a believer in God, but I respect people's right to worship.